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FINDING AND TRAINING QUALIFIED TEACHERS 
FOR AP, IB AND OTHER CHALLENGING COURSES 

MONTPELIER ROOM 

What we'll be discussing in a variety of 
contexts today is how to find and train qualified 
individuals to teach advance placement courses, and, 
in some cases, to be looking at programs such as 
international baccalaureate as a type of corollary or 
concomitant type of entity that does different 
things, but in many respects requires the same type 
of vigorous training that it does to do with advance 
placement. So, since I am, at this point, at the 
college level and deal primarily with the training, I 
will probably yield to one of my colleagues who are 
dealing with the school aspect of it first and then I 
will follow up later. How's that? 

Voice: That sounds great. Let's get 

rolling here . 

New voice: Does everyone have a copy of 

the handout that I have. If not, let me give that to 
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you before I get started. 

My name is Mike Riley, and I'm the 
superintendent of the Bellevue School District, which 
is a school district of about 15,000 kids located 
right outside of Seattle. We have a population that 
is about 20% free and reduced. It's an area that's 
very affluent but has been changing over time. This 
is my fourth year there. Before that I was in 
Baltimore County as an area superintendent, then as 
deputy superintendent. I went to Bellevue in the 
summer of '96 and, as I said, this is my fourth year. 
I'm use to a pretty diverse community, and, so, to 
me, this looks like a very suburban district. It has 
been interesting for me that this community which was 
much more homogenous maybe fifteen years ago and has 
changed over time. I think that has had an impact on 
expectations . 

One of the things myself doing when I 
first got there was preaching higher expectations. 

And the other thing that was very unusual for me when 
I went there was that Washington State is not a state 
that is big into advance placement. In fact, if you 
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take a look at the national rankings, Washington and 
Oregon and Montana and Wyoming and Idaho -- that 
whole northwest quadrant of our country -- is really 
low in terms of advance placement, which was a 
surprise to me. So, I feel very strongly about the 
AP and am a very strong supporter of it and believe 
that it can set standards for the entire school 
district. As I started preaching it, I was also 
running into people who were just opposed to it. And 
one of the things that they were opposed to was the 
idea that it was an elitist kind of program. And 
that area of the country doesn't take to elitism very 
well. And, so, I kept saying it is only elitist if 
we allow to be elitist. If it's AP for everybody, 
then it isn't elitist. It's high standards for all 



kids 



So, what I've done here for this morning 



is to try to give you some background on our school 
district and then some characteristics of our 
program, and I know that the specific topic today is 
supposed to be about recruiting or finding the right 



teachers and then giving them training. But I think 
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that has to be embedded into the whole program j 

: 

j 

because I think there are things that we do when we 
create a program that either is supportive of 
teachers or not and that's it's more than just 
finding the teacher and giving that individual 
support. So, what I would like to do is run through 
this quickly and then have my two colleagues do their 
presentations and then we will try and take questions 
from you in the hour that we have. 

One of the things I've showed you up at 
the top is the growth that we've had in the program. 

I arrived '96- '97 and we had very few AP courses 
being offered in our schools. We started offering AP 
in all of our schools in the '97- '98 school year, but 
you'll see that the numbers didn't jump significantly 
that first year. But then by the third year, we had 
521 tests taken. Last spring, we jumped up to 992. I 
think we'll go well over 1,000 this year, and I 
think, frankly, we've just scratched the surface. 

Scores 3 or higher have jumped from 211 to 631 over 
that same time. The number of kids taking the AP 
tests have gone from 174 to 608. 
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I should also mention that we have an IB 
program, and the IB program isn't even reflected 
here. These are just the AP stats. Our AP 
enrollment, again '96- '97, because it was not really 
designated or not every school offered AP courses, 
there was no good tracking of the enrollments. You 
can see the enrollments now increasing significantly. 
Down at the bottom, the high school enrollment gives 
you some idea of how many students we have in our 9 
through 12 program. 

Here's what I believe are important 
characteristics of our program. First of all, we are 
building our whole curriculum with the idea that AP 
is the culminating course. So, we're basically 
saying all of our strands should end in an advance 
placement program and then backward mapping. What 
I'll frequently say to people is the 11^-h grade 
general math student is not going to be an AP 
student. But, if we look at all kindergarten kids as 
if they can be calculus students, then- we '11 have a 
much greater chance of having all of our kids become 
calculus students. 
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All of our courses are open to all kids. 

So, it's completely student and parent choice if a 
kid gets into an AP course. We list things as 
prerequisites, but we explain to people that those 
are recommendations. So, we'll say to somebody if 
you have not taken, for example, the pre-calculus 
course you may not want to take the calculus course. 
However, it is very clear to folks and this is across 
all of the disciplines that it the student steps up 
and says I want to take the calculus course or 
advance placement literature, whatever the course may 
be, it's open access to the kids. 

All of our courses end in an AP test, 
which we think is a good way for us to hold the 
standard in the course. And, we do that in one of 
two ways. They either take the real test 
administered by the ETS for that particular school 
year, or we give them a practice test on the same day 
that the real test is taken under the same conditions 
and score it and count it as part of their grade. 

So, from the time the students enter, we say the idea 
is to hit the standard that the test exemplifies. 
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Each year our kids take a practice test, which is a 
previously administered test, and they do that about 
five weeks or so before the real test. Then we send 
those out to AP readers -- folks who have scored the 
test previously -- get them back, hand them back to 
the kids and to the teachers and use that as a 
learning tool. And, that's been very helpful to us. 
And, it also helps to have the outside readers read 
them, because you're about five or six weeks before 
the end of course, and your getting an objective 
sense of how the students are going to do when they 
get to the real exam. 

This past January we formed a partnership 
with an online company. They were originally founded 
to offer distance learning courses online--AP 
courses, especially in schools where there wasn't 
enough of quorum for the courses to be offered. 

We've worked a deal with them where that's become a 
teaching tool for us now. So, their course is 
available to us in the regular classroom. And, 
again, in terms of teacher support, I think that's a 
very helpful thing. They are just starting up. 
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We're using them in statistics, calculus and U.S. 
government in the spring. They will have their 
English language and literature courses ready to go 
in the fall. In addition to the teacher being able 
to use the course in the classroom, the materials are 
also available to the kids online in after school 
hours. The students also get a ten week review 
course for free. No student pays any fee for any of 
the online courses. And, again, I think that's 
another way for us to help reinforce and support our 
teachers . 

I have sort of a different take on teacher 
selection and support. I think the key 
characteristics of a successful AP teacher are deep 
knowledge of the academic discipline. So, if I'm 
looking for an AP English teacher, I want somebody 
very grounded in English. I want an English major. 

If I can get somebody with a master's degree, that's 
better. But I want someone who is an expert in their 
field, somebody who believes in and is committed to 
the power of the AP program. And that means again 
for all kids, not just for an elite group of kids. 
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And then see a passion for helping all kids become AP 
students . 

The reason the next two things are there, 
which basically says that I don't think that AP 
teachers should receive any special bonuses or 
receive any special treatment, is I think the 
description that I did in the first paragraph should 
apply to all teachers that we have in schools, not 
just the teachers that we put in advance placement 
programs. So, I feel strongly that we shouldn't say 
our AP teachers are a breed apart . I think we should 
be saying our AP teachers are what we want all of our 
teachers to be . 

I've often had AP teachers say even the 
college board recommends that I have classes of only 
20 or 15, and I say all of our teachers would like to 
have those same circumstances and that, although you 
may have a lot of grading that comes with the advance 
placement courses that you teach, other teachers have 
other kinds of challenges. So, I think that all of 
us would like smaller class sizes, all of us would 
like additional training, all of us would like 
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materials that we need for our courses, and I think 
that we should treat all teachers that way. And, so, 
those are my next two bullets. 

In terms of teacher training, the one-day 
workshop sponsored by the college board -- and I'll 
talk about each one of these individually if you're 
not familiar with these programs -- but the one-day 
workshop sponsored by the college board is a good 
orientation program and also a good way for people 
to link up once a year. 

The best training, I think, are the four- 
day institutes. When we started launching AP , we 
also sponsored a national four-day institute. All of 
our teachers are allowed to go to those things 
without any cost, and, in fact, we have a way we pay 
our teachers for their attendance at the conference. 

It doesn't cost us anything because we charge other 
people to come to it. So, we wind up having a 
conference. Our last four-day institute in the 



spring was for 


400 


or had an 


enrollment 


of 4 0 0 


teachers. 100 


of 


those were 


from inside 


our 


district . And 


the 


300 from 


outside the 


district 
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actually allowed us to make a profit on the 
institute. So, if you are starting up a program and 
looking for good training, my advice would be if you 
don't have an institute in your area -- I had a very 
ripe area, again, because the northwest didn't have a 
lot of involvement with the advance placement 
program, so as we got the thing rolling there was a 
large audience for us . 

The next one, I think, is helpful 
opportunities for structured subject to light teacher 
interactions throughout the year, especially if you 
have kids taking practice exams and those exams being 
returned. That's a wonderful staff development for 
teachers where they can come together and take a look 
at the work from each other' s students and talk about 
what's working and what's not working in their 
classroom. I think the key on advance placement 
staff development is that it's very practical because 
the goals of the course are so specific, and the 
indicators of student performance are so specific 
that you have very focused intentional conversations 
when people get together. 
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We are working with Apex to develop online 
opportunities for sharing lesson plans and samples of 
student work. And, so, we hope that, in addition to 
the face-to-face meetings that we're having, that 
we'll have folks in electronic conversations going 
across the district by next year. 

Mentoring of inexperienced AP teachers by 
experienced colleagues should be intentional, not 
accidental. We are proposing to our community that 
we go on a modified week next year across our whole 
district for 28 schools, which would allow an early 
release every Wednesday for two hours. And, we 
intend to use that early release time as a means for 
teachers to have communication with each other. So, 
even if I have an inexperienced AP teacher in one 
school and an experienced AP teacher in another 
school, because of that common time across our whole 
district, we're hoping to be able to link people up. 
And, again, I think that kind of staff development 
where people are actually talking about their 
specific course and their specific curriculum is the 
most powerful kind. 
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All training opportunities should be made 
available to vertical teams. We are excited this 
year. We've always invited our middle school 
teachers to our advance placement institutes and 
workshops and our four-day program. We are starting 
an elementary strand this year, so we are actually an 
advance placement training institute for elementary 
teachers in math and in English. And, again, it goes 
to support some of the things that we've heard over 
the last two days about where AP really starts is in 
kindergarten. We are hopefully getting people to 
shift into that kind of thinking. 

Teacher support, I think, is critical. 

What I've found is that teachers are often afraid to 
teach AP because they' re hanging out there so 
publicly in terms of their results. Especially, if 
you say you're going to have an open access AP 
program and your goal each year is to increase the 
number of kids in the program, I think the thing that 
frightens the teacher off is I'm getting kids who, 
perhaps, are not going to be typical of AP programs. 
And, so, there's a couple of things that are happen. 
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If I hold the standard in terms of grading, my grades 
may drop and how much pressure am I going to get from 
parents and administrators to pull my grades back up 
or to do something that inflates the grades. The 
second thing that going to happen, and you'll see 
this on our statistics, is if you open your program 
up and you have more kids tests, especially if you 
demand that all kids test, the percentage of 3's and 
above are going to drop. I believe teachers are so 
conditioned to a high test score means that I'm a 
successful teacher that I think the whole district 
has to take a position that it isn't the number of 
high scores that we get, it's how many kids that we 
get into this program and, over time, how to build 
those scores back up. But I think you have to be 
right there holding their hands, shoulder to shoulder 
with them, with parents and the community, educating 
the community and students that don't expect high 
numbers -- a B, a C in an AP course is better than an 
A in another course, and it's okay not to do well on 
a test if you know you've actually participated in 
the rigor of the course. 
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And, I also think, last point under 
support there on the third page, that districts have 
to take a K through 12 approach. So when our AP 
scores are released -- again, we don't just say how 
did a particular AP teacher do, but instead how do 
those scores reflect our entire curriculum K through 
12. Are we really developing the kind of curriculum 
that supports high end achievement in the ll t h and 
12 t h grades. 

And, then, my recommendations. I think 
education reform would take a giant leap if AP or IB, 
or a combination of both, was a national curriculum. 
Somehow, I think we have this sense that if we have a 
national curriculum, it's undemocratic. And I think 
that lack of specificity about what our goal is is 
one of our biggest issues as educators. 

I think teacher prep programs should 
include an introduction to the AP program, all 
teacher prep programs, including elementary prep 
programs. It's the same theory. What's the target 
that we're aiming for here, and, if I know what the 
target is, at least through an introduction to AP 
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standards, then I have a better idea of how that may 
impact what I'm going to do in my 3 r d grade 
classroom . 

For discipline specific secondary 
teachers, I think if I'm an English teacher, I ought 
to be studying, as part of my teacher preparation 
course, what AP demands are, because I think that, 
again, that, along with IB, is the kind of gold 
standard that we have in the country. And I think 
all teachers who are in discipline specific work 
should know what those high standards are. 
Surprisingly, a whole lot of people don't. Even 
people that are teaching the courses that lead up to 
AP really have never sat down and taken an AP test. 

I just did that recently with all of my principals. 

We took the English exam. And I think it was an 
enlightening experience for them, especially for a 
lot of the elementary principals who now had a sense 
of what the demand was at the ll fc h and 12 fc h grade 
level . 

I think the college board should provide 
an elementary and middle school program just like the 
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international baccalaureate does. The international 
baccalaureate program has an early years program and 
a middle years program that is formalized and that 
you get into only through application and passing 
their standards, and I think the AP should do the 
same thing. 

Assessments and accountability would put 
K12 AP on the fast track if, for example, on the 
vertical team that we see AP doing, if there was an 
8 t h grade English assessment that would tell you 
whether you were on your way or not to the advance 
placement standard. I think we'd have a much better 
chance of having our kids reach that high standard. 

I think AP tests should be required, but free for all 
enrolled kids. And I think the percentage of 
students taking AP classes should be one of our 
standard measures -- not just how many 3 and above, 
but what percentage. I don't know how many of you 
have seen Jay Matthews' work, Class Struggle. But 
the idea in Class Struggle is that we shouldn't 
measure AP success or high standards by the number of 
kids 3 or above. We should measure it by the 
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percentage of kids in the senior class that are 
taking AP tests. I think that is, again, just like 
we use SAT standards and everything else, I think 
that would be a wonderful indicator for us . So 
there's my quick run-through. 

Thank you. My name is Brad Richardson. 

I'm the Regional Director for International 
Baccalaureate in North America. I'm going to make 
just a few brief comments because my instructions 
were that we wanted to provide enough time for 
questions and comments after the formal 
presentations. The high standards that we're all 
looking at and how to make them more accessible to 
students is certainly very important to the 
International Baccalaureate. It's one point on its 
agenda, if you will. But there's another point that 
often gets overlooked in International Baccalaureate, 
particularly when people ask how does IB distinguish 
itself from other kinds of programs. It's a very 
important ethic, if you like, and one that I want to 
share with you here. And that is a strong sense of 



internationalism. Internationalism not too long ago 
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was considered sort of a luxury item in the world of 
education. The global economy, I guess, has made our 
world much, much smaller in the last couple of years. 
As a result, we are finding more and more that 
international education, which was once the preserve 
of private, independent and international schools 
around the world, really now is becoming much more 
central and much more important to the state school 
or the public school. So, we're finding that more 
and more a broad range of schools are attracted to 
programs like the International Baccalaureate. I 
offer that as an introductory comment, as I talk 
about, from my perspective, what I think teacher 
selection and teacher training how important that is. 
As was mentioned, the IB program has not only what it 
calls the diploma program. I guess I should take a 
step back and find out how many of you are familiar 
with International Baccalaureate? I don't want to go 
over ground that perhaps you already know. Okay, 
maybe 60% know. So, for you I ask of you a little 
indulgence as I get the rest of us caught up. 

The IB is a non-profit educational 
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organization that's chartered in Switzerland under 
Swiss law. It's headquarters is there. The 
curriculum and assessment center is in Cardiff in 
Wales in the United Kingdom, and there' re regional 
offices around the world that look after the 
interests of IB and represent the interest of schools 
that are attracted to the IB. My region, the North 
American region, looks after schools in Canada, the 
U.S. and the Caribbean. I have colleagues in Buenos 
Aires. They look after the Latin American schools 
participating. There is a Europe/Africa/Middle East 
office in Geneva. And, there is an Asia/Pacific 
office in Singapore. Currently, there are close to 
about 900 schools authorized to offer one or more of 
the IB programs. And that's about 900 schools in 
about 90 countries. 

So, the interests of IB, as you can see, 
are much wider than a national interest. Although, 
they do try to take those into account as they 
develop their programs. 

I'm going to focus most of my comments on 



the diploma program. Although, I don't want to 
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suggest that the middle years program or the primary 
years program are not important in their own right . 
The diploma program is a grade 11 and grade 12, or, 
in some educational systems, the last two years of 
the secondary school sequence. In North American 
terms, by and large, that's grades 11 and 12. 

The program, if you've seen the design of 
the curriculum, you'll see that what we talk about in 
the IB is the hexagon -- that each point on the 
hexagon represents subject groupings that students 
must take. They must take one course from each of 
those subject areas. Again, this is a distinguishing 
feature of the IB. You can't take courses that 
reflect your strengths and avoid those courses where 
you don't feel strong. You must take a course from 
every major discipline. So, what we're talking about 
is in Group 1, which is Language A, it's the 
literature program, it's the language of your home 
culture, wherever that might be. And IB has a very 
strong commitment to that. That is, if English is 
not«if you come from a country where English is not 
your native language, the IB has a commitment to 
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provide you that program in your home country, in 
your home culture. It's very important that we think 
that a student who is truly international today must 
first be grounded in a sense of who that person is. 
Who am I, where have I come from and how is that 
expressed through the literature of my home culture. 

Now, by and large in North America, 
Language A is really English. However, I think the 
IB has tested in something like 65 or 70 Language 
A's. So, there is a very strong commitment towards 
that. So, a student takes a course in that. Then, 
in Language B, which we believe is important, and 
that's a modern foreign language. It's very 
important for an international student to have the 
tools and the perspective and the ability to look out 
from his or her own culture. So, modern foreign 
language is an important part of study. 

Group 3 is called Individuals in Societies 
and that is then the humanities and the social 
sciences, history, and so forth. But it's not a 
national perspective that's fed into the curriculum, 
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it's an international perspective. So, for example, 
if a school were to choose as an option, history, 
they could choose history of the Americas. Americas , 
not of America . So the requirement is that the 
teacher be fluent in the history of Canada, the 
history of Mexico, the history of Latin America, and 
that gets fed into the instruction -- and not simply 
from an American foreign policy point of view, but 
from that culture of its own right. 

There are other histories that are 
available: history of Europe, history of Asia, and 

within Asia, there is Southeast Asia, East Asia, and 
so forth. But, again, I want to stress that there is 
an international perspective that's built into the 
curriculum. It's not assumed, it's built into the 
curriculum . 

Group 4 is Experimental Sciences, and, of 
course, in this country, we're really talking about 
the big 3. But, there are others. We have 
environmental systems and design technology and there 
are a number of other programs that are available 
within that grouping. 
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Group 5 is Mathematics, and the approach 
to mathematics in the IB is an integrated math. And 
that poses, I suppose, a special challenge to schools 
that are looking to adopt the diploma program. How 
do we take these discrete courses that we teach -- 
Algebra 1, Algebra 2, Trigonometry and so on and so 
on. How do we take those courses, those strands, and 
get them to interact with one another so that the 
students are being equipped with tools, to think 
mathematically in an integrated spiraling direction. 

Group 6 is the Arts. We believe it's very 
important for a well-rounded student to be exposed to 
the arts. So, Arts is a very important part of the 
IB program. 

Now those are the six points on the 
outside of the hexagon. And that's just the subject 
content, that's just the subject area. 

The other part that makes this a program 
or a diploma are the important central elements that 
are also required of students. So students are not 
just choosing six subjects, one from each of these 
groups. They're also engaged in, first, a critical 
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thinking course called Theory of Knowledge. The 
Theory of Knowledge course is not a content -driven 
course, but it's a period of reflection -- not navel 
gazing, but active reflection, where the teacher 
challenges the student to ask himself or ask herself 
how do you know what you say you know. Is it because 
I, as a teacher, have told you, because you read it 
in a book? Why do you know these things? How do we, 
as human beings, know? And, what are the problems of 
knowing? What are the challenges of knowing? It's 
really quite telling when a student finishes the IB 
diploma program. I think the thing that they come 
away with is the Theory of Knowledge course. I think 
that's the program that holds them and serves them 
well once they get to university. So, it's an 
important part of the IB program. 

In addition to a Theory of Knowledge 
course, students are required to write a 4-5,000 word 
extended essay -- an independently researched essay. 
Now, this particular part of the program obviously 
draws on a number of excellent college preparatory 
skills. But it also has the function within this 
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curriculum scheme by the broadening the students' 
program. In other words, we've said these are the 
six subjects you have to take. But here's an 
opportunity for you to follow your passion. If you 
don't find it within that hexagon, here's a moment 
where you can break free and really demonstrate your 
own passion and that becomes part of the program. 

Or, it can be the opportunity for the student to add 
greater depth to the curriculum. In other words, 
gosh, we studied this in physics. I'm really quite 
keyed into that and that student can then go into 
greater depth into that particular topic. So, 
Extended Essay is an important part of that program 
and adds coherence to the program. 

Finally, there's another component, a 
central element called CAS, and that's an acronym for 
creativity, action and service. These are the 
categories of extracurricular activities that are 
required of the student. It's very important in the 
IB, we believe, that knowledge should be 
transformative and that knowledge carries 
responsibility. And, students need to be equipped 
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with knowing how do I take what I'm learning in 
school and apply it usefully in the world around me. 
So, there's a sense of community service. There's a 
sense of esthetic or artistic endeavor. There's a 
sense of physical activity that's required of the 
student . 

Quickly, that is a description of the 
hexagon. We believe that this curriculum adds 
breadth to the student, adds depth. There's 
coherence and then there's a strong sense of 
internationalism. Now, how does that translate into 
selecting and teaching or to teacher training? 

Teacher training is probably the most 
critical factor of success within the diploma 
program. This is, you know, we come very short of 
saying it's a required part of any school that is 
participating in the IB program. Not just because 
the curriculum is revised in every subject every five 
years, in some cases there' re major revisions, 
depending on the knowledge that breaks in a 
particular discipline. I'm thinking primarily of the 
sciences. But also because there are newihere'sil 
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guess what's important is that we think that 
assessment methods change within subjects. All of 
that kind of thing is very, very important and we 
want teachers to be up to date on that, not just on 
the knowledge content, but also on how has the 
pedagogy changed for a particular discipline, but how 
has the assessment changed. So, professional 
development becomes an important part of succeeding 
with a diploma program. 

Within our professional development, we 
have a range of workshops that we offer from 
introductory seminars, which help schools to look at 
the program and how do I modify the courses that I 
do, to teacher training workshops that give teachers 
-- and I'll go into detail what those things do -- 
special subject seminars that focus in depth on a 
particular subject. We have focused workshops that 
deal not with content so much, as perhaps with 
assessment or with articulation issues or access 
issues. We also have a summer conference where we 
key into a theme. This summer we have a conference 
in Keystone in Colorado, where we're focusing on the 
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arts, education in the continuing K through 12. How 
does that work, how should that work? 

And, then, because this is an 
international program, schools that become part of 
the IB program are actually part of an advisory 
policy making body within the organization. They 
meet every two years, and they don't just meet in 
North America. They meet, literally, around the 
world. Last year, or two years ago, I guess, they 
met in Montreaux in Switzerland. Next month they'll 
be meeting in Ghana. A couple of years before that 
they met in Djakarta. So, it literally moves around 
the world, and it's very important that schools that 
become involved in the IB program take this notion of 
internationalism quite seriously and participate in 
these programs, which you can see immediately the 
problems that that raises for schools with limited 
budgets and school systems that -- you know talk 
about elitism and so forth, and I can address that 
later if you like. 

But, I want to go back to looking at why 
the teacher training workshops are so important to 
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the diploma program. 

First, they help teachers who have not had 
this experience. They help them to work with 
external assessments. Now, as you know, there are 
many, many schools that have never had that 
experience. Our hope and what we encourage schools 
to do, particularly those schools that have not had 
that experience, to begin with the advance placement 
program. We want them to take AP ' s . We want their 
teachers to have a clear sense of what is it like to 
relate what I'm doing in the classroom to an external 
standard, an external measure. And that's also 
important to the IB. 

Part of the IB's assessment, however, is 
internal assessment. That is, in some cases up to 
30% of the student's final mark is determined by the 
classroom teacher. Now, we need to assured that the 
teacher knows how to arrive at that assessment. It's 
not that we think that teachers are bad teachers, but 
the assessment is very specific depending upon the 
discipline. In some cases, it's an oral exam. In 
some cases, it's a group project. In some cases, 
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it's a lab performance. And the teachers need to 
have clear in their minds what are the criteria 
against which I'm measuring my students so that I can 
provide an accurate internal reflection of the 
achievement of that student . So internal assessment 
is an important part of our workshops. 

Again, a unique feature, maybe not so 
unique, but an important feature of the IB, is that 
we're criterion referenced. Teachers need to know 
how to work with standards and how to identify when a 
student has achieved those standards and at what 
level . 

So, the teacher training workshops are 
also about looking at sample works and measuring them 
against the published criterion. 

Finally, it's work with modifying, 
creating or modifying course work. As we've been 
told throughout this morning and yesterday, it's not 
just what you can do at grades 11 and 12 that makes a 
difference. It's what do you have to do at grade 8, 
grade 9, grade 10 or grade 5 or grade 4, and so on. 

So, the teacher training workshops also try to work 
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with those ideas. How do I take these standards and 
walk backwards in order to help prepare students to 
meet with success with that program. 

Now, when you get down into the middle 
years program and the primary years program, you're 
dealing with a broader based program, even than with 
the diploma program. And the curriculum model 
implies extensive work with colleagues, not only on 
campus within a department, but with the feeding high 
school program. Remember I said it is a middle years 
program, not a middle school program. Middle years 
program spans grades 6 though 10 . So the teachers in 
the middle years have to coordinate their efforts 
with the high school, in order for those students to 
get what they need to be successful with the middle 
years program. 

There are peculiar areas of interaction. 
It's not so discipline driven as the diploma program. 
Instead, the disciplines are important only as they 
interact with one another in what we call areas of 
interaction . 

Then, in the primary years program -- only 
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a brief comment. In the primary years program, there 
is a very strong curriculum coordination effort that 
needs to be made with the primary years program, if 
the program is going to be successful. So, release 
time becomes an important part of what you can do to 
support the development of middle years program and 
primary years program. Here, what you're suggesting 
for Bellevue that formal time is being provided on 
Wednesday afternoons. For that to take place, it has 
to happen or the program is limited in its success. 
Thank you . 

Voice: As a follow-up to this, what both 

of these gentlemen have been speaking about is the 
actual nuts and bolts of the operation of the 
program. Part of what my responsibility in Missouri 
is, is not to be concerned so much with how our 
program operates as how to prepare the faculty -- 
secondary school teachers, middle school teachers, 
junior high school teachers -- to prepare students 
for rigorous academic work. You read my handout. I 
don't think I need to insult your intelligence by 
reciting that which is in front of you. 
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But, I think one of the things we need to 
consider is: when we are teaching college level 

courses, and that is, indeed, what an advance 
placement course is -- a college level course 
designed by college faculty and high school faculty 
to meet the standards of colleges and universities 
across the country and internationally, as most of us 
know. How do you find a faculty member who is going 
to have the capacity to teach at that level? But, 
secondly, how do you find a faculty member that 
understands the content of the discipline that can 
translate that content into strategies and pedagogies 
applicable to students at a high school level? This 
is not to say that they cannot function at college 
level, but most high schools run courses five days a 
week. This is different than colleges and so the 
strategies and pedagogies are different. 

So, what I do in my job as Director of 
Advance Placement Teacher Development for the State 
of Missouri is to set up training institutes in the 
summer. These are intensive eight, nine, ten day 
institutes depending on the discipline. They run 
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from eight o'clock in the morning until 5 o'clock in 
the afternoon, with a little bit of homework at night 
that usually last until 11 or 12. 

The basic approach to developing the 
institutes is to enable high school faculty, junior 
high school faculty, grade school faculty to teach 
the content of the discipline and to prepare students 
to be successful on the examination. Now we hate to 
hear we're teaching for the test. Now I don't want to 
disabuse anyone, but anyone who teaches, if he is 
indeed an intelligent teacher, teaches for the tests 
that he gives. He doesn't look at the outcome of 
what we want to have happen, and we prepare students 
to meet those outcomes. That is the test. 

So the first thing that we do to every 
person who comes into one of these AP institutes is 
say we're very happy you're here. Here are the 
materials you have, and, by the way, in 15 minutes we 
are going to start taking the AP test. And that's 
the first experience many of them have ever had, 
because these are teachers new to AP . 



Most of the comments we get after 3 hours 
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are: high school kids do this? I couldn't even do 

this. Many people do not believe that high school 
students can do this. But there are over a million 
exams every year that demonstrate that high school 
students can do this. And globally over 60% of those 
students perform well on those exams. 

( Inaudible . ) 

Even if a student gets 2, he has done 
extremely well, because he's probably done better 
than most college students, who are taking the same 
course on campus, when we think of a D as being an 
acceptable grade to pass a course at the college 
level (I think it completely unacceptable) . 

When a student gets a 3 on an AP 
examination, you know that student is running at the 
level of a B. So that 2 must be a C. 1 doesn't 
happen very often. 

What we do the first thing is we hit these 
people with the examination, then we grade it. We go 
through Ruberts and we actually take, not only the 
multiple choice aspects of it, but we take all the 
free responses, and we grade the free responses 
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examination after going through several examples of 
the grading procedure. They then grade their own 
free responses. And they are vicious. But the 
payback is that they understand what it is they need 
to do at this point to get their students to perform, 
not just on the test, but to perform in the box. 

One of the other comments is: boy, do I 

have to change what I'm doing. I cannot teach my 
classes the way I've been teaching. Whew, this 
requires that I have to do outside reading. This 
requires that I have to beef up my understanding of 
the discipline. This means that I've got to talk to 
this college faculty member. This means that I have 
to talk to my junior high school colleague and my 
middle school colleague because I can't do it all. 

It leads to a complete understanding of the necessity 
for vertical team, which the AP (Inaudible) . AP is 
(Inaudible) in this concept. And, if it is used 
correctly, it drives curricula structure. 

So, within the first two days, teachers 
have come to the awareness that business as usual no 
longer works. From that point on, we don't teach 
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calculus, we don't reach history. We made some 
assumptions that people know these disciplines. What 
we do is take pieces of disciplines, such as manifest 
destiny in the history program, and say, okay, how do 
you teach this in your classes? What are youire the 
important things that a student needs to know about 
manifest destiny, not the facts, but the concepts? 

How do you then take those concepts and turn them 
into teaching strategies? And everyone at that point 
becomes responsible for defining his own set of 
strategies, and then we'll discuss the strategy, as 
well as the content and what aspects of content to be 
dealt with these strategies. By the way, the 
institute's taught by a college level faculty member, 
who is experienced in peer reading, such as me. An 
experienced high school AP teacher whose students 
have performed at least 80% or better on the AP 
examination * and have been teaching AP for a minimum 
of three years and who have, in most cases, have some 
experiences with the reader. What I'd like to do is 
get my high school people that are teaching these AP 
courses into a reading so that they can see exactly 
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what it looks like. It makes for a better 
preparation . 

So, within that context we get a series of 
micro teaching sessions. So that whatever the topic 
may be, it could be something in calculus, it could 
be something in music (I teach music theory, and 
there are seven or eight discrete theories that we 
deal with on the AP exam) and within the context of 
that institute, strategies are developed and teaching 
is done for critique by everyone who comes. What 
worked, what didn't work. 

But, gradually, what we do on these 
institutes is develop a level of confidence in each 
of the participants to go to their institution and 
teach an AP course seminar. Then, we ask them define 
materials. Okay, so you're going to teach this, what 
materials do you have for development. I bring a 
wealth of materials. My colleague brings a wealth of 
materials, and this is how it's done. It's also a 
handout. That's easy. Okay, you take my handouts, 
how do you use those handouts with your particular 
program. We ask each teacher at that point to define 
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the demographics of his program or her program. Who 
are your students? What are your students? What is 
their economic level? What's their social life? 

What does your school do? What is the budget that 
your school has? How are you going to implement this 
program on the TWA principle: take what's available. 
It was mentioned very strongly that you can't wait 
until the resources get there, because they're never 
going to come. So what you do is take what's there - 
- what you've got that is available to you, what 
resources do you have. Then, we ask them to define 
those resources. We ask them to define who the key 
school personnel are above and below that they need 
to become acquainted with, in order to effectively 
implement a strong AP program. They suddenly find 
out that there are teachers in the elementary school 
programs that have brains and that these people are 
very useful to them. They suddenly find out that you 
can teach calculus to a 12 t h grader, but, unless the 
principals have been laid in the first grade, which 
is easy to do, you're not going to have an effective 
calculus course. 
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So, this is all part of the teacher 
training we do. Well, who are the teachers who come? 
Well, if you look at the handout, you see an 
application form in there. This is this year's 
application form, and you'll notice there are about 
22 different institutes that we're running. For the 
most part, English vertical teams and math have had a 
great response in Missouri. But, if you look at the 
back of the application, you will see there are some 
questions that are asked of people. Who are you? 

What kind of certification do you have? How many 
years have you been teaching? Do you want to live on 
campus? They don't have to ask that question. Have 
you ever had any AP training? What kind of training 
have you had, and, if you haven't, fine? But more 
importantly, what is it you're going to do with an AP 
course? If you have no idea of what you're going to 
do, then there is no point in coming to training, 
because I'm not going to tell you what to do, because 
we emphasize the fact that AP courses are 
individualized to fit institutional priorities. They 
are not a proscribed curriculum. You fill the 

Ace-Federal Reporters, Inc. 

Nationwide Coverage 
800 - 336-6646 



43 



202 - 347-3700 



410 - 684-2550 



1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

22 



42 



curriculum. There are things that get tested, and 
you'd better be able to be prepared to deal with 
those things. But, we're not going to tell you how 
that curriculum runs. You're going to build it to 
suit the needs of your students. If they are weak in 
some areas, then you're going to concentrate in those 
areas. If they can do other areas, then a whole lot 
of concentration is not necessary. Then we ask the 
high school principal, AP supervisor, curriculum 
coordinator to write a recommendation for this 
person. Why are you sending this person to AP 
training? And if it's your brother-in-law, it 
doesn't pass. But what is it about this person 
academically that would make him a good AP teacher? 
Then, we ask the principal to sign at the bottom that 
says if you're going to send me teachers for training 
and spend the state's money, then you need to 
implement an AP course in each subject area for which 
you sent teachers for training within two academic 
years. And I follow up and I check to see what's 

done ' BEST COPY AVAILABLE 

So, the teachers have to be motivated. 
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They have to have content specific certification, 
which gets into real problems some times with 
elementary school teachers, because many elementary 
school teachers have degrees in education. They got 
a BS in b- s-. There are some real problems there. 
Many elementary school teachers have found themselves 
going back to school to get disciplined so that they 
can build their own programs. That has been very, 
very effective. 

Now what are the rewards to the teacher? 
The institutes are free. It doesn't cost them 
anything. They get three graduate credit hours free. 
They get materials free. They get text books free. 
They get instruction by highly qualified faculty 
free. They have an Internet site that they can 
address where they can have a discussion group free, 
because I have an Internet site which is on the front 
of this. We have a follow-up meeting every year, 
which in our case is going to be on the 18 t h and 19 fc h 
this weekend at the Lake of the Ozarks, free. I pay 
their hotel bills. I feed them and I bring in 
speakers. So, there' re some real rewards to doing 
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this. Even if they don't get their rewards in high 
school of having additional pay or having release 
time, the rewards come through my program at the 
state level that provides ongoing professional 
development . 

That's essentially the Missouri model. 
There are a variety of other models. But the 
important thing to remember about them is that we're 
not teaching disciplines. We're teaching people how 
to use disciplines to make connections with other 
disciplines to benefit students and the growth of 
students in their academic environments, to enable 
them to take that last, wasted year and a half of 
high school -- according to * , most kids complete 

high school by the middle of the ll^h grade -- to 
take that last, wasted three semesters and do 
something with them that going to provide them with 
the challenges of rigorous work that's going to 
provide students with an opportunity to earn advanced 
credit, advanced standing, advanced placement, that's 
going to enable students to walk into a college -- 
whether it be Southeastern State University or 
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Harvard University, as Demon * said last night -- 
with a year of college under his or her belt, knowing 
full well that the quality and the rigor of the 
courses which they have had at the secondary level 
are the equivalent, and, in many cases, superior to 
the level (Inaudible) the courses that they take at 
the secondary level . 

So, that's about all I have to say. 

Teacher training, to me, is the most important 
component of any successful AP program. And the 
ongoing professional development of these persons is 
what makes things successful. So, any questions? 

I'm Ed Corley with the teacher quality 
program in the Department of Education. You guys 
were so anxious to get going, I thought we were 
starting a few minutes later than we did. But, 
anyway, let me pose a question or a couple of 
questions for the panelists to bring the discussion 
from the standpoint of what I'm involved in, which is 
making grants to states and university school 
partnerships to improve teacher preparation across 
the country. 
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One is, if you would talk about the extent 
to which AP and the International Baccalaureate can 
be helped in some strategy to improve the teacher 
preparation program with large universities that are, 
for example, in Missouri. And, then, secondly, the 
extent to which both of the programs can be part of 
the strategy of whole school improvement, so that all 
teachers in the school and all students benefit from 
what's being done. Thanks. 

Voice: You want to tackle the university 

part of that? 

Voice, presumably Cossaboom: From the 

university perspective, I'm working with the various 
departments, I have not been working with the school 
of education, because many times that's a useless 
enterprise. So, what I've been looking at is dealing 
with the teacher trainers in the disciplines in the 
college of arts and sciences and bringing them into 
the AP program as readers and test developers, with 
the intent that they will go back to their programs 
and in their methods and techniques courses, which 
they teach for the college of education, they will 
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employ the AP model as part of the strategy of 
teacher education. We look at South East Missouri, 
we look at AP as a very important cog in our wheel of 
early college credit. And it's in our best interest 
at that point to make sure that all of our graduates 
-- and this, of course, has not happened -- but all 
of our graduates in teacher education are aware of 
what the AP program has to offer and has at least 
taken one AP examination in the discipline. That's 
one way to tackle it . 

Voice: The comment that I'd make about 

how does it affect whole school reform -- I think the 
key to that is the way we approach it is to say that 
all of courses that we offer, all the disciplines, 
culminate in AP . So, it's the ending course for 
every discipline, and we take the position that all 
kids can be AP students. It's going to take us a 

while to get there. But, I think as long as that 
goal is out there specifically for people, it means 
each discipline is working to try to get kids to that 
higher level of achievement, you know, from 
kindergarten straight up. And, since we've been 
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using that approach, I'm finding that we're 
continually analyzing what we are doing at each level 
to see if it's high enough to reach that standard at 
the end. It's put a lot of pressure on, for example, 
the middle school level, trying to determine where we 
need to be by the end of 8 t h grade in order to get 
the kids there for 12 t h grade. On the staff 
development side, what I'd say real quickly is, I 
think AP is a model for staff development in the 
sense that the best staff development that I've ever 
seen is when teachers come together and look at 
examples of student work and try to figure out how to 
increase student performance on a specific set of 
measures. And, I think that's how AP works, and I 
think what we've seen ourselves doing is using that 
same model now and doing that across the entire 
district, starting, for example, with kindergarten 
reading assessments that we do where the teachers 
will come together, look at the work that the kids 
produce, and then try to make changes in their own 
teaching . 

Voice: Gentlemen, how is your program 
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actually funded? Is it funded by the university or 
the state department, where does the money actually 
come from for the teacher institutes trying to get 
certification. 

A: That's somewhat covered in my handout. 

But, quickly, in 1996 the state legislature looked at 
a number of early college programs -- dual credit 
being the principal among them -- and saying this is 
nonsense . We need to do something to increase the 
rigor of these courses being taught to students. 

And, so, building on the Eisenhower grant program, 
which is for math and sciences, the state legislature 
appropriated about $250,000 and made it available to 
the colleges and universities and said if you want to 
be an AP site, why don't you make a proposal to us, 
to the coordinating board for higher education. 

Well, South East did, and so we got the lion's share 
of and Truman State came in afterwards and got the 
residuals. My budget, total budget, we have is 
$330,000 between the two institutions. I have about 
$240,000 of it. The money is granted through the 
coordinating board for higher education for both of 
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these institutes as non-G&E money. Money that cannot 
be touched by the college and university and absorbed 
into any other program. It is specified strictly for 

AP teacher development. I have a budget here I would 

be happy to share. Each year we get an 
appropriation, ongoing appropriation, to each of the 
universities, Truman State and South East, as 
increased by whatever percentage of funding is 
allocated to higher education, usually 1-2% a year. 
But its very specified money. 

Voice: My question is for Dr. Grammey 

from Bellevue. 

Voice : Riley . 

In your statement, you said that all 
students take the test. Some take it for ETS so that 
they can get the score, but the other students just 
take a practice test. Now, is there a note on their 
transcript that they have taken AP courses. 

A: Yes, and that's why it a requirement. 

That's how we are keeping ourselves honest that it's 
a real AP course, because I think there are places 
where 25 kids will be in an AP course and 5 kids 
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test. And I think it's anyone's guess whether you're 
really getting a real AP course in situations like 
that . 



Voice: What make's the differentiation, 

because that was my question, too, as to which kids 
are going to take the test? 

A: It's up to the kid. What we say to 

the kids is that they all have to take a test, they 
all have to take a real AP test under the same 
circumstances that ETS administers their test. But I 
found over time that it's a battle not worth fighting 
and, if you get where you want to get anyway, if you 
say to kids you are all going to take the advance 
placement exam, it's all going to be on this same 
day, it's all going be under the same conditions, you 
take the real one you're also guaranteeing yourself 
or you've got a likely shot at getting some college 
credit to go with it, the vast majority of our kids 
then test. But to force the test, and I've played 
around with this at different times in my life, but 
to force the test still makes me a little bit 
uncomfortable because you'll always get the kids who 
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says, even with assistance I can't afford the exam. 
And we do not only the assistance that comes from the 
college board, but also additional school assistance, 
but we'll still have some kids who say they have a 
hard time with that. 

The second thing is some universities, 
like some of the academies, for example, don't 
recognize the AP credit, and it's a pretty argument 
to make when you say to somebody you have to pay $70, 
you're taking three courses, so that's $210, and, no 
your university won't recognize the credit anyway. 

Voice: In South Carolina, where I am 

from, the testing will be funded. So all our kids 
take the test . 

A: That's great. I think Florida is 

doing that too and I think it's a wonderful idea. 

Q: Undecipherable. 

A: Well, it generates its own money. 

It ' s terrific . 

Q: Just by * 

A: By the tuitions. What we do is, you 

know the idea from the beginning that this would be 
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free to our own teacher and then we also have 
professional development hours so that our teachers 
can actually use the professional development hours 
which means that they are getting per diem salary for 
attending. So it's a real good deal for our folks. 
But the money pays for the speakers and for their 
accommodations, both their stipends and their 
accommodations, comes from the tuition of folks 
outside of our district. So we run, our last 
institute was for 400 teachers and 300 were 
outsiders, which generated the revenue that we needed 
-- actually we made about $50,000 on the institute. 

Q: Was there someplace you to guide you 

on how to run one? 

A: They're run all over the country and, 

to be honest with you, the first year we did, the 
college board was wonderful, because what they helped 
us with was who should we invite as the speakers. 

Once you have the right speakers, then you start 
getting the kind of attraction that you need. Our 
institute has grown over the last couple of years to 
that number now where we're at, which I think is one 
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of the highest in the country. But I mean it was a 
shoestring the first year that we ran it. We're 
actually hitting only the fourth institute. So, it's 
gotten to that number only through three. Yes. 

Q: Can Title II funds be used for AP 

staff development? 

A: I haven't used them that way, so I 

don' t know the answer to that . 

Q: You said that no student pays to use 

the online service. I'm sure there is a fee, and 
what is it and who pays it? 

A: Well, what we've done, remember we 

just kicked it off this year in January and we took 
advantage of a state grant was for $20,000 and so 
that allowed us to get the review course for all the 
kids that are signed up in AP U.S. government, 
calculus and statistics, and also the teacher support 
and the training. So the $20,000 from the state 
grant -- our state is trying to encourage online 
learning -- covered this spring. For next year, for 
all of our kids to be covered, you can see that our 
enrollments are going to be over 1,500 again, but for 
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all of our classes and all of our kids to be covered, 

we are paying $100,000 our of our school budget. But ; 

1 

! 

the review course alone, the ten-week review course, 
is about, if you were just doing it on your own, 
would be $200 a kid. So the $100,000 that we're 
spending, I'm looking at it as the same kind of 
expense I would make for text books or materials. 

Right now, we have about, our average expense per kid 
is about $6,500 or so, which is roughly the U.S. 
average. We set aside about $1,000,000 for 
curriculum support every year, which is text book 
materials and all the rest of it, especially when 
we're launching new curriculum. And, so, the 
$100,000 is just part of that $1,000,000 budget. 

Q: I presume we can just go online, or do 

you have any information? 

A: Actually, the person from Apex is 

here. His name is Brian Barnett and he is one of the 
people making the afternoon presentation. He, I'm 
sure, would be very interested in talking with you. 

Voice: I think we have to finish up so we 

get one more question up here. 
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Q: If you want to have AP as a 

culminating course in all your schools, do you have 
any plans with dealing with under-prepared teachers. 
So, for instance, you have one bad AP physics class 
someplace. Your physics teacher, in a lot of cases, 
typically was a biology teacher that somehow got 
drafted into teaching physics and truly doesn't have 
the background that might be needed. What do you do 
then? 

A: Well, we're working real hard with 

that. The first thing, I guess it's an 
advantage/disadvantage. We have about 900 teachers 
in our system, and over the last 3 springs, we've 
hired 100 teachers a year and it's not because of 
increasing enrollment. But we're facing the same 
thing that a lot of places in the country are facing, 
which is the high level of staff retirements. We had 
a school system that was stable for a long set of 
years. So, as those people are retiring, we get out 
of the gate as fast as we can. We've been offering 
people open contracts in February and say we'll 
figure out later where we're going to place you. If 
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you're a physics teacher, I'd probably hire you 
today. So, I mean it's that kind of aggressiveness 
that's helped us with that. So, our physics teachers 
are physics majors. In fact, this last year we 
snagged a Ph . D . in physics, a female teacher that we 
were just delighted by. But we did that by getting 
out really early. 

Q: So you're not retraining your old 

faculty. You're just waiting for them retire. 

A: Both. No, no, both. But when you 

mentioned physics specifically, I don't think I can 
train a biology teacher to be an AP physics teacher. 
Right. But I do think I can take an English teacher 
and help the English teacher move up, someone who's 
an English major, to an AP literature level. 

Voice: Well, thank you for coming. 
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